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NOISE SUPPRESSION APPARATUS 



FTF.T.D OF THE INVENTION 

The present invention relates to a noise suppression 
5 apparatus for use in a system, such as a voice communication 
system or a voice recognition system used in various noise 
circumstances, for suppressing noises, other than an object 
signal . 

10 KACKGROUND OF THE INVENTION 

A noise suppression apparatus for suppressing non-object 
signals, for example, noises superimposed on voice signals is 
disclosed, for example, in Japanese Patent Application 
Laid-Open (JP-A) No. 8-221093. The theoretical grounds of the 

15 apparatus disclosed therein is the so-called Spectral 
Subtraction Method (SS method) , which focuses on the amplitude 
spectrum. This method is introduced in document 1 (Steven F. 
Boll, "Suppression of Acoustic noise in speech using spectral 
subtraction" , IEEE Trans. ASSP, Vol. ASSP-27, No. 2, April 

20 1979). 

The conventional noise suppression apparatus disclosed 
in JP-A No. 8-221093 is explained below, referring to Fig. 13. 
In Fig. 13, reference numeral 101 denotes a framing processing 
unit, 102 denotes a windowing processing unit and 103 denotes 
25 a Fast Fourier Transformation processing unit. Reference 



numeral 104 denotes a band dividing unit, 105 denotes a noise 
estimation unit, 106 denotes an NR value calculation unit, 107 
denotes an Hn value calculation unit, 108 denotes a filter 
processing unit , 109 denotes a band conversion unit , 110 denotes 
5 a spectrum correction unit, 111 denotes an inverse Fast Fourier 
Transformation processing unit, 112 denotes an overlap adding 
unit, 113 denotes a voice signal input terminal, 114 denotes 
a voice signal output terminal, and 115 denotes an output signal 
terminal. Inside the noise estimation unit 105, reference 
10 numeral 121 denotes an RMS calculation unit, 122 denotes a 
relative energy calculation unit, 123 denotes a maximum RMS 
calculation unit, 124 denotes an estimated noise level 
calculation unit, 125 denotes a maximum SNR calculation unit 
and 126 denotes a noise spectrum estimation unit. 
15 The principle of the function of the conventional noise 

suppression apparatus will be explained below. 

An input voice signal y [ t ] , which includes a voice signal 
component and a noise component is input into the voice signal 
input terminal 113. The input signal y [t] is a digital signal, 
20 which has been sampled under a sampling frequency FS, for 
example. Then, the signal is sent to the framing processing 
unit 101 so as to be divided into frames, each of which has a 
frame length of FL . Thereafter the signal processing is carried 
out frame by frame . 
25 Prior to the calculation in the Fast Fourier 



Transformation processing unit 102, each of the framed signal 
Yframe t3 ' k l sent from the framing processing unit 101 is windowed 
in the windowing processing unit 102 . Here j denotes a sampling 
number and k denotes a frame number. 

The signal suffers, for example, a 256 points Fast Fourier 
Transformation in the Fast Fourier Transformation unit 103. 
The values of the obtained frequency spectrum amplitude are 
divided into, for example, 18 bands in the band dividing unit 
104. The band divided input signal spectrum Y [w, k] is sent 
to the spectrum correction unit 110 along with the noise 
spectrum estimation unit 126 and the Hn value calculation unit 
107 in the noise estimation unit 105. Here w denotes a band 
number . 

Then, the framed signal y frame [j, k] are discriminated into 
the voice signal frames and noise frames in the noise estimation 
unit 105 so that noise like frames are identified. 
Simultaneously the estimated noise level value and the maximum 
SNR (Signal to Noise ratio) are sent to the NR calculation unit 
106. 

The RMS calculation unit 121 calculates the root mean 
square (RMS) of each signal component in each frame, and outputs 
the result as an RMS value RMS [k] . 

The relative energy calculation unit 122 calculates the 
relative energy of a k-th frame, which relates to the 
attenuation energy in connection with the former frame, and 



outputs the result . 

The maximum RMS calculation unit 123 obtains a maximum 
RMS value. The maximum RMS value is necessary for estimating 
an estimated noise level value described later and a so-called 
maximum SNR, which is a proportion of the signal level to the 
estimated noise level. The maximum RMS value is outputted as 
the maximum RMS value MaxRMS [k] . 

The estimated noise level calculation unit 124 selects 
the minimum RMS value among the RMS values of the last five frames 
of the current frame (local minimum values), to output it as 
an estimated noise level value MinRMS [k] . The minimum RMS 
value is preferable to estimate the background noise or the 
background noise level. 

The maximum SNR calculation unit 125 calculates the 
maximum SNR MaxSNR [k] , on the basis of the maximum RMS value 
MaxRMS [k] and the estimated noise level value MinRMS [k] . 

The noise spectrum estimation unit 126 calculates a time 
averaged estimated value N [w, k] of the background noise 
spectrum, based on RMS value RMS [k] , the relative energy, the 
estimated noise level value MinRMS [k] and the maximum RMS value 
MaxRMS [k] . 

The NR value calculation unit 106 calculates the NR [w, 
k] , which is used in avoiding a sudden change of the filter 
response . 

The Hn value calculation unit 107 generates a filter Hn 



[w, k] for removing the noise signal from the input signal, on 
the basis of the band divided input signal spectrum Y [w, k], 
the time averaged estimated value N [w, k] of the noise spectrum 
and the output NR [w, k] of the NR value calculation unit 106. 
The filter Hn [w # k] generated in this unit has a response 
characteristic that the noise suppression increases when the 
noise component is larger than the voice signal component, and 
decreases when the voice component is larger than the noise 
component . 

The filter processing unit 108 smoothes the value of the 
filter Hn [w, k] on the frequency base as well as on the time 
base. The smoothing on the frequency base is carried out by 
the median filtering processing. An AP smoothing is carried 
out on the time base only in voice signal sections and in noise 
sections, and the smoothing is not carried out for the signals 
in transient sections . 

The band conversion unit 109 carries out an interpolation 
processing of the value of the band divided filter, which is 
sent from the filter processing unit 108, so as to adapt it for 
inputting into the inverse Fast Fourier Transformation unit 111 . 
The spectrum correction unit 110 multiplies the output of the 
Fast Fourier Transformation unit 103 by the aforementioned 
interpolated value of the filter so that a spectrum correction 
processing, in other words, a noise component deduction 
processing, is carried out. The spectrum correction unit 110 



outputs the noise remaining signal. 

The inverse Fast Fourier Transformation processing unit 
111 carries out the inverse Fast Fourier Transformation, on the 
basis of the noise deducted signal obtained in the spectrum 
correction unit 110, and outputs the obtained signal as a signal 
IFFT . The overlap adding unit 112 carries out an overlap 
addition of the signal IFFT at the boundary portions of each 
of the frames. The obtained output voice signal is outputted 
from the voice signal output terminal 114. 

In the aforementioned noise reducing apparatus , the 
filter removes the noise spectrum from the input spectrum, 
corresponding to the proportion of the estimated noise signal 
to the input voice signal (estimated SNR) as well as the noise 
signal level. The spectral suppression processing is carried 
out, by controlling the filter characteristic, according to the 
distribution of the voice signal and the noise signal. The 
distortion of the object signal is restricted to the minimum 
and a large suppression of the noises are secured. Although 
the aforementioned noise reducing apparatus has such an 
excellent characteristic. However, the conventional 

apparatus has following problems. 

Because the grounds of the control are the estimated noise 
signal level and the estimated SNR, the noise suppression can 
not be appropriately carried out when the estimation of the 
estimated noise signal level is not correct. In such a case, 



signals are excessively suppressed. 

In the control of a suppression amount using the estimated 
noise signal, the estimated noise signal is generated from the 
average spectrum of the past frames which were identified to 
be noise signal. Therefore, when the input voice signal level 
changes suddenly, for example, at the head portion of words in 
speech, a time-lag occurs in controlling the filter. As a 
result, one feels that head portion of words in speech is 
extinguished or hidden, or a strange sound is heard. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to solve the 
aforementioned problems, and to provide a noise suppression 
apparatus which can suppress noises agreeably in hearing, and 
assure that the quality does not deteriorate even in a noisy 
circumstance where the noise level is high. 

The noise suppression apparatus according to the present 
invention calculates a noise amplitude spectrum corresponding 
to the noise likeness of the input signal frame using the input 
amplitude spectrum of the frame. Then, calculates a noise 
amplitude spectrum correction gain and a noise removal spectrum 
correction gain from the already calculated noise amplitude 
spectrum, input amplitude spectrum and respective coefficients . 
Then, calculates a first noise removal spectrum by deducting 
the product of the noise amplitude spectrum and the noise 



amplitude spectrum correction gain from the input amplitude 
spectrum. Then, calculates a second noise removal spectrum by 
multiplying the first noise removal spectrum by the noise 
removal spectrum correction gain. The second noise removal 
5 spectrum is converted into a time domain signal. Thus, it is 
possible to carry out a suitable spectrum reduction and spectrum 
amplitude suppression corresponding not only to the noise 
signal level but also to the input signal level are carried out, 
even at a section where the input sound signal suddenly changes, 

10 for example, at the head portion of words in speech, the 
impression of extinguishment or hiding of the head portion of 
the words in speech, due to an excessive spectrum reduction or 
suppression can be avoided. 

Other objects and features of this invention will become 

15 apparent from the following description with reference to the 
accompanying drawings . 

RRTEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing the construction of the 
20 noise suppression apparatus according to the first embodiment 
of the present invention. 

Fig. 2 is a block diagram showing the construction of the 
noise suppression apparatus according to the second embodiment 
of the present invention. 
25 Fig. 3 is a block diagram showing the construction of the 



noise suppression apparatus according to the third embodiment 
of the present invention. 

Fig. 4 is a block diagram showing the construction of the 
noise suppression apparatus according to the fourth embodiment 
5 of the present invention. 

Fig. 5 is a block diagram showing the construction of the 
noise suppression apparatus according to the sixth embodiment 
of the present invention. 

Fig. 6 is a block diagram showing the construction of the 
10 noise suppression apparatus according to the seventh embodiment 
of the present invention. 

Fig. 7 shows a graph of noise amplitude correction gain 
limiting value as a function of all frequency band SNR. 

Fig. 8 shows a graph of noise removal spectrum correction 
15 gain limiting value as a function of the input signal power. 

Fig. 9 shows a graph of the noise amplitude correction 

gain. 

Fig. 10 shows a graph of the noise removal spectrum 
correction gain. 

20 Fig. 11 shows a graph of the phone reception weighting 

value W a as a function of the noise amplitude spectrum correction 
gain. 

Fig. 12 shows a graph of the phone reception weighting 
value W p as a function of the noise removal spectrum correction 
25 gain. 



Fig. 13 is a block diagram showing the construction of 
the noise suppression apparatus of the prior art. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
5 A noise suppression apparatus according to a first 

embodiment of the present invention will be explained below, 
referring to the accompanied figures . 

Fig. 1 is a block diagram showing the construction of the 
noise suppression apparatus according to the first embodiment 
10 of the present invention. The apparatus comprises input signal 
terminal 1, time/ frequency conversion unit 2, noise likeness 
analyzing unit 3, noise amplitude spectrum calculation unit 4, 
spectrum correction gain limiting value calculation unit 5, 
correction gain calculation unit 6, spectrum deduction unit 7 , 
15 spectrum suppression unit 8, frequency/ time conversion unit 9 
and an output signal terminal 10. 

In this first embodiment, the spectrum correction gain 
limiting value calculation unit 5 and the correction gain 
calculation unit 6 constitute the spectrum correction gain 
20 calculation unit. 

The principle of the function of the noise suppression 
apparatus of the present invention will be explained below with 
reference to Fig. 1. 

An input signal s [t ] , which is sampled at a predetermined 
25 sampling frequency (for example, at 8 kHz) and divided into a 

10 



set of frames having a predetermined length (for example, 20 
ms) is input into the input signal terminal 1. The input signal 
s [t] can be a pure background noise, or it can be a mixture 
of a voice signal mixed with the background noise. 
5 The time /frequency conversion unit 2 transforms the input 

signal s [ t ] into an amplitude spectrum S [ f ] and a phase spectrum 
P [f], using a Fast Fourier Transformation, (for example, 256 
points FFT). The method of FFT is well known, hence, the 
explanation of FFT is omitted, here. 

10 The noise likeness analyzing unit 3 comprises linear 

predictive analyzing unit 14, a low pass filter 11, an inverse 
filter 12, auto-correlation analyzing unit 13 and updating rate 
coefficient determining unit 15. 

At first, a filtering processing of the input signal is 

15 carried out in the low pass filter 11 to obtain a low pass 
filtered signal. The cut-off frequency of this filter is 2 kHz , 
for example. As a result of the low pass filtering processing, 
the influence of noises in the high frequency region is removed, 
which allows a stable analysis of the input signal. 

20 Then, the linear predictive analyzing unit 14 carries out 

a linear predictive analysis of the low pass filtered signal 
to obtain a set of linear predictive coefficients, for example, 
tenth order a parameters. The inverse filter 12 carries out 
an inverse filtering processing of the low pass filtered signal, 

25 using the set of linear predictive coefficients, to output a 



low pass linear predictive residual signal (hereinafter called 
"low pass residual signal"). Subsequently, the auto- 
correlation analyzing unit 13 carries out the auto-correlation 
analysis of the low pass residual signal, to obtain a positive 
5 peak value RAC max . 

The updating rate coefficient determining unit 15 
calculates the noise likeness level N level , on the basis of , for 
example, the positive peak value RAC max , a power Rpow of low pass 
residual signal of the present frame and a power Fpow in all 

10 over the frequency region of the signal of the present frame 
sent from the input terminal 1. Thereafter the updating rate 
coefficient determining unit 15 calculates the noise amplitude 
spectrum updating rate coefficient r, on the basis of the 
obtained noise likeness level. 

15 The noise likeness N level is determined, on the basis of 

the values of a RAC ma3C , Rpow and Fpow, according to the following 
rule. Where RAC th/ R th and F th are, respectively, a threshold 
value of the maximum of the auto-correlation, a threshold value 
of the power of the low pass residual signal, and a threshold 

20 value of the power in all over the frequency region of the signal 
of the present frame. Each of them is a predetermined constant 
value . 

start : 

N level = 0 ; ; ; the noise likeness level is cleared to zero 
25 if (RAC max > RAC th ) N level = N 

level 



if (Rpow > Rpow th ) N level = N level + 1 

if (Fpow > Fpow th ) N level = N level + 1 

output N level ; ; ; the noise likeness level is outputted 
end: 

The noise amplitude spectrum updating rate coefficient 
r is given corresponding to the noise likeness level N level , as 
shown in Table 1. Larger the value of r is, stronger the 
influence of the input amplitude spectrum of the present frame 
on an noise amplitude spectrum N [f ] is . The noise amplitude 
spectrum N [f ] is an average value of the noise spectrum in the 
past and is explained below. 



[Table 1] 



Noise likeness 
level 


Noise level 


Updating rate 
coefficient r 


0 


Noise level is high 


0.5 


1 


Noise level is high 


0.6 


2 


Noise level is high 


0.8 


3 


Noise level is high 


0.95 


4 


Noise level is low 


0.999 



The noise amplitude spectrum calculation unit 4 updates 
the noise amplitude spectrum N [f], on the basis of the noise 
amplitude spectrum updating rate coefficient r, which is sent 
from the noise likeness analyzing unit 3, and the input 
amplitude spectrum S [f ] output the time/frequency conversion 
unit 2, according to equation (1). Where N old [f] and N new [f] 
denote, respectively, the noise amplitude spectrum before and 



after the updating. Hereinafter, the noise amplitude spectrum 
N [f ] designates the noise amplitude spectrum N new [f ] after the 
updating. 

N new [f]= (1-r) • N old [f]+ r • S[f] "-(1) 

5 By the way, the initial value of the noise amplitude 

spectrum N [f ] is given, by setting the noise amplitude spectrum 
updating rate coefficient r in equation (1) to 1.0. 

The spectrum correction gain limiting value calculation 
unit 5 calculates a noise amplitude spectrum correction gain 

10 limiting value L a and a noise removing spectrum correction gain 
limiting value L p , on the basis of the input amplitude spectrum 
S [f ] sent from the time /frequency conversion unit 2 and the 
noise amplitude spectrum N [f ] sent from the noise amplitude 
spectrum calculation unit 4. 

15 First, the power Ps (dB value) of the input amplitude 

spectrum S [f] is obtained, according to equation (2). 

Ps (dB)=10 log 10 (2(S[f]'S[f])) (2) 
Next, the power Pn (dB value) of the noise amplitude 
spectrum N [f ] is obtained, according to equation (3) . By the 

20 way, the value of Pn is limited in a region: Pn MIN ^ Pn ^ 0 . 
Where Pn MIN designates a minimum value (dB value) of the power 
of the noise signal and is a predetermined value. The function 
MAX (a, b) inequation (3) is a function which selects and returns 
the larger one between its two arguments a and b. 

25 Pn (dB)=MAX(-10 log 10 ( Z (N[f ] -N[f ] ) , Pn MIN ) (3) 



Subsequently, the SNR snr all , which is a proportion of the 
input signal to the noise signal in all over the frequency range 
of the present frame, is obtained, on the basis of the values 
Ps and Pn, according to equation (4). 
5 snr all (dB) = Ps + Pn *** (4) 

Then, the noise amplitude spectrum correction gain 
limiting value L a is determined and outputted according to 
equation (5) , on the basis of the all frequency range SNR snr all 
obtained with equation (4). The quantities ct^ and in 

10 equation (5) represent, respectively, the maximum value (dB) 
and the minimum value (dB) of the noise amplitude spectrum 
correction gains . Each of them is a predetermined constant 
value. And the quantities SNR X and SNR h are threshold values 
regarding the all frequency range SNR. Each of them is a 

15 predetermined constant. The quantity L a is a maximum value 
limiter, which determines the maximum deduction coefficient at 
the deduction of noise amplitude spectrum from the input 
amplitude spectrum, which is carried out in the after-mentioned 
spectrum deduction unit 7. Fig. 7 show a profile of L a in 

2 0 equation (5) with respect to snr aU . 



<W ;Snr «U >= SNR H 

(a MAX -a M!N )snr all +(SNR h a mN + SNR^^ )/(SNR h -SNR;) 



(5) 

;SNR h >snr all >= SNR l 



;SNR; >snr all 



Subsequently, the difference dPs between the input signal 
power Ps and a threshold value Ps th is calculated according to 

15 



equation (6). Where the quantity Ps th is a threshold value of 
the input signal power and is a predetermined constant value. 
dPs(dB) - Ps - Ps th • • • (6) 

After calculating the difference dPs between the input 
5 signal power and the threshold value, a limiting value of 
the noise removing spectrum correction gain (3 [f ] is determined 
and outputted, according to equation (7). The quantity L p is 
a maximum value limiter regarding the amplitude suppressing 
quantity. The amplitude suppressing is carried out in the 
10 after-mentioned spectrum suppression unit. Fig. 8 shows a 
profile of in equation (7) with respect to Ps. 



L fi (dB) = < 



Pn dPs < 0 

Pn-dP sdPs>0 and Pn-dPs>0 ••• (7) 

0 Pn-dPs < 0 



The correction gain calculation unit 6 calculates the 
noise spectrum correction gain a [f ] and the noise removal 

15 spectrum correction gain )3 [f], on the basis of the input 
amplitude spectrum S [f ] , noise amplitude spectrum N [f ] , noise 
amplitude spectrum correction gain limiting value L a and the 
noise removal spectrum correction gain limiting value L p . 
Using a [f ] , the noise amplitude spectrum N [f ] can be corrected 

20 for each frequency component. And using the noise removal 
spectrum correction gain ]3 [f], the after-mentioned first 
noise removal spectrum S s [t] is corrected for each frequency 
component . 

16 



First, SNR snr sp [f], which is a proportion of the input 
amplitude spectrum to the noise amplitude spectrum, is 
calculated for each frequency component, according to equation 
(8). Where the quantity fn is the Nyquist frequency. 



™r sp [f}(dB) 



[20 log 10 (*[/]/ AT[/] ifs{f]>N[f] 

/=0, ,/„ (8) 

0 else 



A noise amplitude spectrum correction gain a [f] is 
calculated according to equation (9), on the basis of SNR snr sp 
[f] for each frequency component obtained with equation (8), 
the minimum value Pn MIN of the noise power, the noise amplitude 
10 spectrum correction gain limiting value L a and a phone reception 
weighting value W a [f ] . Where the minimum value Pn MIN of the 
noise power is a predetermined constant value in (9) . And MIN 
(a, b) is a function, which returns the smaller one between its 
two arguments a and b. 
15 gain a = MIN(snr sp [f] • W a [f] + Pn, 0) 

a[f] = L a • {(Pn MIN + gain a )/Pn MIN } ••• (9) 

According to equation (9), when the value snr sp [f] 
increases, namely, when the SNR of each of the frequency 
components increases, the value of the gain a increases, as a 
20 result, also the noise amplitude spectrum correction gain a [f ] 
increases. Consequently, in the spectrum deduction unit 7, 
when a spectrum component has a large SNR, the deduction 
coefficient, which is a proportion of the deduction in the 

17 



reduction of noise spectrum from the input signal spectrum, 
increases. On the other hand, when a spectrum component has 
a small SNR, the corresponding deduction coefficient is small. 
Fig. 9 shows a profile of a [f] with respect to snr sp [f]. 
5 The value of the phone reception weighting value W a [f ] 

is predetermined according to its parameter, frequency f . And 
the value of W a [f] increases, when the frequency increases. 
As a result of this weighting, the value of a [f ] decreases in 
the high frequency region. Consequently an excessive 

10 suppression in the high frequency region can be avoided so that 
a generation of a strange sound in the frequency region can be 
avoided. Fig. 11 shows a profile of the W a [f ] . 

Subsequently, the noise removal spectrum correction gain 
P [f ] is calculated, on the basis of the input amplitude spectrum 

15 S [f], the noise amplitude spectrum N [f], a phone reception 
weighting value W p [f ] and a noise removal correction gain 
limiting value L^, according to equation (10). The noise 
removal spectrum correction gain (3 [f ] is used in the correction 
of each amplitude of a second noise removal spectrum Sr [f]. 

gain, =MIN(snr sp [fYW,[f] + L^ 0) 
20 *** (10) 

According to equation (10), when the value snr sp [f] 

increases, namely when the SNR increases, the value of gain p 
decreases, therefore, the noise removal spectrum correction 
gain |3 [f] increases, correspondingly. Consequently, when a 



spectrum component has a large SNR, the amplitude of the noise 
removal spectrum, the output of the after-mentioned spectrum 
suppression unit 8, increases. On the other hand, when a 
spectrum component has a small SNR , the amplitude of the output 
5 is small. Fig. 10 shows a profile of (3 [f ] with respect to the 
value of snr sp [f]. 

The phone reception weighting value W p [f] is, similar 
to the aforementioned W a [f], predetermined according to its 
parameter, frequency f . The value of W p [f ] increases, when 

10 the frequency increases. As a result of this weighting, the 
value of (3 [f] decreases in the high frequency region. 
Consequently, excessive suppression in the high frequency 
region can be avoided so that a generation of a strange sound 
in the frequency region can be avoided. Fig. 12 shows a profile 

15 of the W p [f ] . 

The spectrum deduction unit 7 obtains a product of the 
noise amplitude spectrum N [f ] and the noise amplitude spectrum 
correction gain a [f], which is sent from the correction gain 
calculation unit 6. Then, the spectrum deduction unit 7 

20 subtracts the product from the input amplitude spectrum S [f ] 
to output the first noise removal spectrum S s [f], according 
to equation (11). When the obtained first noise removal 
spectrum S s [f] is negative, the spectrum deduction unit 7 
carries out a recovering procedure , namely the result is changed 

25 to zero or a predetermined low level noise n [f ] . As a result 



of the multiplication of the noise spectrum by the correction 
gain a [f ] , it is possible to decrease the reduction by the noise 
spectrum component, when the SNR is small. And it is possible 
to increase the reduction by the noise spectrum component, when 
the SNR is large. Consequently, an excessive spectrum 
reduction at a small SNR can be suppressed. 

W]-a[/]-W] if S[f]-a[f]*N[f] _ 

sU1 [0 or n[f] else 

The spectrum suppression unit 8, according to equation 
(12), multiplies the first noise removal spectrum S s [f ] by the 
noise removal spectrum correction gain |5 [f ] , which is sent from 
the correction gain calculation unit 6, to output a second noise 
removal spectrum S r [f ] . By multiplying the first noise removal 
spectrum S s [f ] by the noise removal spectrum correction gain 
p [f], it is possible to suppress the residual noise after the 
reduction of the spectrum in the spectrum deduction unit 7 . 
Also a musical noise, which appears as a result of the spectrum 
deduction, can be suppressed. Moreover, the amplitude 
suppression at a small SNR is weakened, and the amplitude 
suppression at a high SNR can be enhanced. As a result, an 
excessive amplitude suppression at a small SNR can be avoided. 

S r [f ]= p [f ] • SJf ] ■ ' • (12) 

The frequency/ time conversion unit 9 carries out a 
procedure inverse to that in the time /frequency conversion unit 
2. For example, it carries out an inverse Fast Fourier 

20 



Transformation to obtain a time signal s r [t] , on the basis of 
the second noise removal spectrum s r [f ] and the phase spectrum 
P [f], then superimposes the time signals at the boundary 
portions of the neighboring frames to output a noise suppressed 
signal from the output signal terminal 10. 

By multiplying the noise spectrum by the noise amplitude 
spectrum correction gain a [f], it is possible to decrease the 
reduction by the noise spectrum components when SNR is low, and 
to increase the reduction by the noise spectrum components when 
the SNR is high. Thus, an excessive spectrum reduction at low 
SNR can be avoided. Further, by multiplying the first noise 
removal spectrum by the noise removal spectrum correction gain 
P [f ] , it is possible to suppress the residual noise after the 
reduction of the spectrum as well as a musical noise, which 
appears as a result of the spectrum reduction. 

When the SNR is small, the amplitude suppression is 
weakened, on the other hand, when the SNR is large, the amplitude 
suppression can be enforced. Thus, an excessive amplitude 
suppression at low SNR can be avoided. Moreover, even when the 
level of the input sound signal suddenly changes, for example, 
at a head of words in speech, the spectrum reduction procedure 
and the spectrum amplitude suppression procedure are carried 
out, corresponding not only to the noise signal level but also 
to the input signal level. Therefore, an impression of the 
extinguishment or hiding of the head of words in speech as well 



as the impression of the spectrum change, which may be caused 
by an excessive spectrum reduction as well as an excessive 
suppression, can be avoided. Consequently, it is possible to 
suppress the noise in noise sections and to avoid an excessive 
suppression of spectrum in sound sections , simultaneously, thus , 
a suitable noise suppression can be attained. 

The noise suppression apparatus according to the second 
embodiment of the present invention is explained below, 
referring to Fig. 2. 

Fig. 2 is a block diagram showing the construction of the 
noise suppression apparatus according to the second embodiment . 
The construction of the apparatus differs from that shown in 
Fig. 1 in that the spectrum correction gain limiting value 
calculation unit 5 is removed, and newly a spectrum smoothing 
coefficient calculation unit 21 and a spectrum smoothing unit 
22 are added. The other elements are identical to that in the 
apparatus of the first embodiment. Therefore, their 
explanation are omitted. The principle of the function of the 
second embodiment is explained below with reference to Fig. 2. 

The spectrum smoothing coefficient calculation unit 21 
calculates a time base spectrum smoothing coefficient y t for 
smoothing the spectrum in the time base, and a frequency base 
spectrum smoothing coefficient y f for smoothing the spectrum 
in a frequency base, corresponding to the level of the noise 
likeness of the input signal, which is outputted from the noise 



likeness determining unit 3. 

The smoothing coefficient corresponding to the noise 
likeness can be calculated, for example, referring a table which 
gives a smoothing coefficient corresponding to a noise likeness . 
5 Table 2 is an example of such a table. Using such a table, it 
is possible to select smoothing coefficients y t , y f so as to 
enhance the smoothing in noise sections when the noise likeness 
is large. On the other hand, it is possible to select smoothing 
coefficients y t , y f so as to weaken the smoothing when the noise 
10 likeness is small, namely, in sound sections. 



[Table 2] 



Noise 

likeness 

level 


Noise level 


Smoothing 
coefficient Yt 


Smoothing 
coefficient y f 


0 


Noise level 
is high 


0.5 


0.7 


1 


Noise level 
is high 


0.6 


0.8 


2 


Noise level 
is high 


0.7 


0.85 


3 


Noise level 
is high 


0.8 


0.9 


4 


Noise level 
is low 


0.9 


0.95 



The spectrum smoothing unit 22, according to equations 
15 (13) and (14), smoothes the input amplitude spectrum S [f] and 
the noise amplitude spectrum N [f ] in the time base as well as 
in the frequency base, using the time base smoothing coefficient 
Y t and the frequency base smoothing coefficient y ff and 



calculates a smoothed input amplitude spectrum S sm [f ] and a 
smoothed noise amplitude spectrum N sm [f ] . 

First, the input amplitude spectrum S [f ] and the noise 
amplitude spectrum N [f] are smoothed in the time base to 
calculate a time smoothed input amplitude spectrum S t [f ] and 
a time smoothed noise amplitude spectrum N t [f], according to 
equation (13) . Here the S pre [f ] , N pre [f ] are the input amplitude 
spectrum and the noise amplitude spectrum in the last former 
frames. Where fn is the Nyquist frequency. 

S t [f] = y t • S[f] + (l-7t) • S pre [f], f-0 fn 

N t [f] = 7t • N[f] + (l-y t ) * N pre [f], f=0 fn •••(13) 

Next, the time smoothed input amplitude spectrum S t [f ] 
and the time smoothed noise amplitude spectrum N t [f] are 
smoothed in the frequency base obtained using equation (13) 
according to the equation (14) to calculate a smoothed input 
amplitude spectrum S sm [f] and a smoothed noise amplitude 
spectrum N sm [f]. They are outputted from the spectrum 
smoothing unit 22. 

S sm [f] = y f • S t [f] + (l-y f ) • S t [f-1], f=l fn 

N sm [f] = y f • N t [f] + (l-y £ ) ' N t [f-1], f=l fn •••(14) 

The correction gain calculation unit 6 calculates a noise 
amplitude spectrum gain a [f] and a noise removal spectrum 
correction gain p [f ] , in place of the input amplitude spectrum 
S [f ] and the noise amplitude spectrum N [f ] , using the smoothed 
input amplitude spectrum S sm [f ] and the smoothed noise amplitude 



spectrum N sm [f ] . 

First, a smoothed SNR snr sp . sm [f ] for each of the frequency 
components is obtained, using the smoothed input amplitude 
spectrum S sm [f ] and the smoothed noise amplitude spectrum N sm 
[f], according to equation (15). 



™r sp _ sm [f](dB) = 



20log m S sm [f]/N sm [f] if S sm [f]>N sm [f] 

/«0, ,f n (15) 

0 else 



Then, a smoothed noise amplitude spectrum ot sm [f ] and a 
smoothed noise removal spectrum correction gain (3 sm [f] are 
calculated, using the smoothed SNR snr sp . sm [f], according to 
equations (16) and (17). 

gain a - MIN(snr sp _ sin [f ] ■ W a [f] + Pn, 0) 

Qf sm [f] = aw • {(Pn MIN + gain a ) /Pn MIN } (16) 

gain, - MIN (snr m [/] • W p [f] + Pn{- fi MIN ), 0) 

* • • ( 17 ) 

^J/]=io (8 ^ /20) 

In this second embodiment, the correction gain is 
obtained, using the smoothed SNR snr sm [f ] . Therefore, in noise 
sections, where the SNR (the ratio of input sound signal to the 
noise signal) is small, the variation of the spectrum correction 
gain can be strongly suppressed. On the other hand, in sound 
sections, where the SNR is large, the variation of the 
correction gain is not so strongly suppressed. 

The equations (16) and (17) differ from the equations (9) 
and (10) in the first embodiment. The former equations use 



neither the noise amplitude spectrum correction gain limiting 
value L a nor the noise removal spectrum correction gain limiting 
value L p . The quantity in equation (16) is the noise 

amplitude spectrum correction gain maximum value, and the 
quantity (3 min in equation (17) is the noise removal spectrum 
correction gain minimum value (p min = Pn). Each of them is a 
predetermined constant value. 

In this second embodiment, the spectrum smoothing 
coefficient is controlled, corresponding to the level of the 
noise likeness. Therefore, it is possible to select the 
smoothing coefficients so as to enhance the smoothness, when 
the noise likeness is strong, to weaken the smoothness, when 
the noise likeness is small, namely, in sound sections, and to 
enhance the smoothness, when the noise likeness is strong, 
namely, in noise section. Thus, a further suitable control of 
the spectrum correction gain is possible, and a suitable noise 
suppression can be attained. 

The feeling that the noise removal spectrum changed 
discontinuously can be weakened remarkably, when the 
preciseness of the spectrum correction gain is low, namely when 
the SNR is low, for example, due to high level noises. 

As another modification of the first embodiment, it is 
possible to introduce the spectrum smoothing procedure 
explained in the second embodiment into the first embodiment. 
Fig. 3 is a block diagram showing the construction of the third 



embodiment . 

The spectrum smoothing unit 22 calculates the limiting 
values L a and L p , on the basis of the smoothed input amplitude 
spectrum S sm [f ] and the smoothed noise amplitude spectrum N sm 
[ f ] , according to a procedure explained in the second embodiment . 
The spectrum correction gain limiting value calculation unit 
5 calculates the noise amplitude spectrum correction gain 
limiting value L a and the noise removal spectrum correction gain 
limiting value L p , according to a procedure similar to that in 
the first embodiment . 

The correction gain calculation unit 6 calculates the 
noise amplitude spectrum correction gain a [f ] and the noise 
removal spectrum correction gain 0 [f ] , according to equations 
(9) and (10) as in the first embodiment. In the calculation 
of the gains a [f] and (3 [f], the smoothed input amplitude 
spectrum S sm [f ] and the smoothed noise amplitude spectrum N sm 
[f ] r which are sent from the spectrum smoothing unit 22, along 
with the noise amplitude spectrum correction gain limiting 
value L a and the noise removal spectrum correction gain limiting 
value L p , which are sent from the spectrum correction gain 
limiting value calculation unit 5, are used. 

The other construction of the third embodiment are 
identical to those explained in the first and second embodiments . 
Therefore, their explanation is omitted. 

When this third embodiment is employed, a synergistic 



advantages of the first and second embodiments can be obtained, 
adding to the advantages of the first embodiment. As a result, 
further suitable noise suppression can be attained. 

The spectrum smoothing coefficient corresponding to the 
5 state of the input sound can be calculated, for example, on the 
basis of the SNR of the present frame. Fig. 4 is a block diagram 
showing the construction of the fourth embodiment. 

First, the spectrum smoothing coefficient calculation 
unit 21 obtains the SNR SNR fr of the input signal in the present 
10 frame, according to equation (18). 



frequency base spectrum smoothing coefficient are obtained, on 
15 the basis of the SNR SNR fr of the frame, according to equation 
( 19) . The time base spectrum smoothing coefficient is used for 
smoothing in the time base, and the frequency base spectrum 
smoothing coefficient is used for smoothing in the frequency 
base . 



SNR fr (dB)=lO\og 



2S[/]«S[/] 
W[f]*N[f] 



(18) 



Next, a temporal coefficient y t * of the time base spectrum 
smoothing coefficient and a temporal coefficient y £ ' of the 



20 





else 





(19) 



else 



Then, according to equation (20), AR smoothing of the 



temporal smoothing coefficients Yt' and Yf' are carried out, 
using the smoothing coefficients y(° 1(i )t and y(old) f of the 
former frame , to output the time base spectrum smoothing 
coefficient *y t and the frequency base spectrum smoothing 
5 coefficient Yf* 

y t = 0.8 • Yt' + °- 2 * Y(old) t 

Y f = 0.8 • Yf' + °- 2 *Y (old) £ ••• (20) 

In this fourth embodiment, the input amplitude spectrum 
and the noise amplitude spectrum are smoothed, using a spectrum 

10 smoothing coefficients , which correspond to the SNR of the input 
signal . On the basis of these quantities , a spectrum correction 
gain is calculated. And the noise suppression processing is 
carried out, using the spectrum correction gain. Therefore, 
the variation of the spectrum correction gain can be controlled, 

15 corresponding to the SNR of the input signal. Thus, according 
to this fourth embodiment, it is possible to weaken the strange 
feeling that the noise removal spectrum in the time base or in 
the frequency base changed discontinuously , even in noise 
sections, for example, where the SNR is low. Namely, it is 

20 possible to suppress the generation of a strange sound in the 
output sound so that a suitable suppression of noise can be 
attained. 

As another modification of the first embodiment, it is 
possible to divide the input amplitude spectrum into a plurality 
25 of bands, instead of classifying the input amplitude spectrum 



according to frequency components. The noise amplitude 
spectrum correction gain as well as the noise removal spectrum 
correction gain are calculated, on the basis of the mean 
spectrum of each band. And the spectrums can be corrected, 
5 using these gains . 

In this fifth embodiment , the spectrum band dividing unit 
precedes the spectrum correction gain limiting value 
calculation unit 5 . This spectrum band dividing unit divides 
the input amplitude spectrum, which is sent from the 

10 time/frequency conversion unit 2 # into a plurality of frequency 
bands and calculates the mean spectrum of each of the frequency 
bands. Simultaneously, the spectrum band dividing unit 
divides the noise amplitude spectrum, which is sent from the 
noise amplitude spectrum calculation unit 4, into a plurality 

15 of frequency bands and calculates the average spectrum of each 
of the frequency bands . 

The spectrum band dividing unit divides the input 
amplitude spectrum into, for example, 16 channels (hereinafter 
abbreviated to ch) , and calculates the average spectrum S ave [ch] 

20 of the input signal of each of the frequency channels and the 
average spectrum N ave [ch] of the noise signal of each of the 
frequency channels, according to equation (21). n ch is the 
number of spectrum component in channel ch. 
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S ave [ch] = XS[f]/n ch 

f (21) 

N ave [ch]-jN[f]/n ch 

Next, the spectrum correction gain limiting value 
calculation unit 5 calculates an input signal power Ps ave and 
a noise signal power Pn ave# on the basis of the average spectrum 
5 S ave [ch] and N ave [ch] obtained using equation (21) , and obtains 
a total SNR snr all _ ave , according to equation (22). Pn MIN is a 
minimum noise power and a predetermined constant. 
Ps ave (dB)=10 log 10 (2 S ave [ch] • S ave [ch] ) 
Pn ave (dB)=MAX(-10 log 10 (2 N ave [ch] • N ave [ch], Pn MIN ) 
10 snr all _ ave =Ps ave + Pn ave ••• (22) 

Subsequently, the noise amplitude spectrum correction 
gain limiting value L a and the noise removal spectrum correction 
gain limiting value L p are calculated, on the basis of the 
obtained input signal power Ps ave and the noise signal power Pn ave , 
15 in place of the Ps and Pn in the first embodiment. 

The correction gain calculation unit 6 calculates the SNR 
snr sp [ch] of each channel, according equation (23), then 
calculates the noise amplitude correction gain a [ch] and the 
noise removal spectrum correction gain (3 [ch] of each channel, 
20 on the basis of the SNR snr sp [ch] . Here Nch is the total number 
of the channels . 

r;i/jm nO\og w (S ave [ch]/N ave [ch]) if S ave [ch]>N me [ch] ch=o,...,N CH 
snr 9 [ch]<dB)-\ Q dse 
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(23) 

The correction gains are inputted to the spectrum 
deduction unit 7 and the spectrum suppression unit 8. A value 
corresponding to each of the spectrum component is selected in 
the unit 7 and 8, respectively. Then the spectrum reduction 
procedure and the spectrum amplitude suppression procedure are 
carried out, respectively. 

When this fifth embodiment is employed, adding to the 
advantages of the first embodiment of the present invention, 
one can obtain advantages to reduce the amount of the 
calculation for the spectrum correction gain as well as to 
reduce the memory space for storing the spectrum correction 
gain. 

As another modification of the fourth embodiment, the 
input amplitude spectrum can be divided not corresponding to 
the frequency component but into a plurality of band region, 
and to calculate the spectrum smoothing coefficient on the basis 
of the average spectrum of each of the band regions . Fig . 5 
is a block diagram showing the construction of the sixth 
embodiment . 

In Fig. 5, reference numeral 23 denotes a spectrum band 
dividing unit. The spectrum band dividing unit 23 divides the 
input amplitude spectrum, which is sent from the time /frequency 
conversion unit 2, into a plurality of frequency bands, and 
calculates the average spectrum of each of the frequency bands . 



The spectrum band dividing unit 23 divides also the noise 
amplitude spectrum, which is sent from the noise amplitude 
spectrum calculation unit 4 , into a plurality of frequency bands , 
and calculates the average spectrum of each of the frequency 
5 bands . 

The spectrum band region dividing unit 23 divides the 
input amplitude spectrum , into 1 6 bands , for example , and 
calculates the average spectrum S ave [ch] of the input signal 
and the average spectrum N ave [ch] of the noise signal in each 

10 of the band channel ( called channel ch ) , according to the 
procedure similar to equation (21). 

Subsequently, the spectrum smoothing coefficient 
calculation unit 21 calculates the SNR SNR fr . ave of the present 
frame, on the basis of the average spectrum S ave [ch] of the input 

15 signal and the average spectrum N ave [ch] of the noise signal, 
according to (24). 

IS \ch\ • S \ch\ 

Then the spectrum smoothing coefficient calculation unit 
21 calculates and outputs the time base spectrum smoothing 
20 coefficient Yt and tlie frequency base spectrum smoothing 
coefficient y ff on the basis of the SNR SNR fr _ ave calculated using 
the average spectrum, in place of the SNR SNR fr . The calculation 
is carried out, according to equations (14) and (15) in the 
second embodiment . 
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The spectrum smoothing unit 22 smoothes the average 
spectrum S ave [ch] of the input signal and the average spectrum 
N ave [ch] of the noise signal in either of the time base and the 
frequency base, then calculates an average spectrum S sm _ ave [ch] 
of the input signal and a smoothed noise average spectrum N sm _ ave 
[ch], according to equations (25) and (26). This procedure is 
carried out, on the basis of the time base smoothing coefficient 
y t and the frequency base smoothing coefficient y ff which are 
obtained from the average spectrum. 

First, the average spectrum S ave [ch] of the input signal 
and the average spectrum N ave [ch] of the noise signal are 
smoothed in the time base, and an average spectrum S t . ave [ch] 
of the time smoothed input signal and an average spectrum N t . ave 
[ch] of the time smoothed noise signal are obtained, according 
to equation (25). S pre . av6 [ch] and N pre _ ave [ch] in equation (25) 
are, respectively, the average spectrum of the input signal and 
the average spectrum of the noise signal in the former frame. 
Here, Nch is the maximum number of the channels. 

S t . ave [ch]=Yt ' S ave [ch] + (1-Yt) ' S pre-ave [ch] , ch=0 N ch 

N t . ave [ch]=y t • N ave [ch] + (1-Yt) ' N pre . ave [ch] , ch=0 N ch 

(25) 

Subsequently, the average spectrum S t . ave [ch] of the time 
smoothed input signal and the average spectrum N t . ave [ch] of the 
time smoothed noise signal obtained according to equation (25) 
are smoothed in the frequency base, to obtain a smoothed input 



amplitude spectrum S sm , ave [ch] and a smoothed noise amplitude 
spectrum N sm . ave [ch] , which are outputs of the spectrum smoothing 
unit, according to equation (26)* 

S sm _ ave [ch]= Yf * S t _ ave [ch] + (1-Y f ) ■ S t _ ave [ch-1] , ch=0 N ch 

5 N sm _ ave [ch]-Yf * N t . ave [ch] + (1-Yf) * N t . ave [ch-1] , ch=0 N ch 

••• (26) 

The correction gain calculation unit 6 calculates the 
noise amplitude spectrum correction gain a [ch] and the noise 
removal spectrum correction gain (3 [ch] for each of the channels , 
10 on the basis of average spectrum S sm . ave [ch] of the smoothed input 
amplitude spectrum and the average spectrum N sm _ ave [ch] of the 
smoothed noise amplitude spectrum in place of the smoothed input 
amplitude spectrum S sm [f] and the smoothed noise amplitude 
spectrum N sm [f]. 

15 First, a smoothed SNR Snr sm _ ave [f ] for each of the channels 

is obtained, on the basis of the average spectrum S sm _ ave [ch] 
of the smoothed input amplitude spectrum and the average 
spectrum N sm _ ave [ch] of the smoothed noise amplitude spectrum, 
according to equation (27). 

l20log w (S sm _ ave [ch]/N sm _ ave [ch] if S sm _ ave [ch]>N sm . ave [ch] 
20 ^J^]W = | 0 (27) 

Then, a smoothed noise amplitude spectrum correction gain 
a sm [ch] and a smoothed noise removal spectrum correction gain 
p sm [ch] are calculated, on the basis of the smoothed SNR Snr ch _ sin 
[ch], according to equations (28) and (29). 
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gain a = MIN( snr ch-sm [ch] • W a [ch] + Pn, 0) 

cc sm [ch]- cw • {(Pn MIN + gainJ/Pn HIN } (28) 

gain 0 = MIN(snr ch _[ch] • W p [ch] + Pn(= /3 MIN7 0) 

P m [ch] = 10 isahi ' /7Q) (29) 
Finally, the spectrum reduction procedure and the 
spectrum suppression procedure are carried out, on the basis 
of the obtained smoothed noise amplitude spectrum correction 
gain a sm [ch] and the smoothed noise removal spectrum correction 
gain p sm [ch] . 

When this sixth embodiment is employed, one can obtain 
advantages in that it is possible to reduce the amount of the 
calculation for the spectrum smoothing coefficients and for 
smoothing the spectra as well as to reduce the memory space for 
storing the spectrum smoothing coefficient, adding to the 
advantages of the second embodiment of the present invention . 

As another modification of the third embodiment, a 
combination of the fifth and sixth embodiments is possible. Fig 
6 is a block diagram showing the construction of the seventh 
embodiment . 

The spectrum band dividing unit 23 divides the input 
amplitude spectrum into a plurality of frequency bands and 
calculates the average spectrum for each frequency bands. 
Further, the spectrum band dividing unit 23 divides the noise 
amplitude spectrum into a plurality of frequency bands and 
calculates the average spectrum for each frequency bands, in 



the same manner as in the sixth embodiment. 

The spectrum smoothing unit 22 smoothes the average 
spectrum S ave [ch] for each frequency band of the input signal 
and the average spectrum N ave [ch] for each frequency band of 
5 the noise signal. The smoothing is carried out in the time base 
and in the frequency base, using the time smoothing coefficient 
Y t and the frequency smoothing coefficient y f , which are obtained 
in the spectrum smoothing coefficient calculation unit 21 so 
that a smoothed input average spectrum S sm _ ave [ch] and a smoothed 

10 noise average spectrum N sm _ ave [ch] are calculated. 

Then the spectrum correction gain limiting value 
calculation unit 5 calculates the input signal power Ps ave and 
the noise signal power Pn ave , on the basis of the smoothed input 
average spectrum S sm _ ave [ch] and the smoothed noise average 

15 spectrum N sn) . ave [ch] , according to equation (22) so as to 
calculate an all frequency range SNR snr all . ave . Pn MIN in equation 
(22) is a minimum noise power and is a predetermined constant. 
Subsequently, the noise amplitude spectrum correction 
gain limiting value L a and the noise removal spectrum correction 

20 gain limiting value L p are calculated, on the basis of the 
obtained input signal power Ps ave and the noise signal power Pn ave 
in place of the Ps and Pn in the first embodiment. 

The correction gain calculation unit 6 obtains the SNR 
snr sp [ch] for each channel, according to equation (23), then 

25 calculates the noise amplitude spectrum correction gain a [ch] 



and noise removal spectrum correction gain (3 [ch] , using the 
obtained SNR Snr sp [ch] . N ch in equation (23) is the total number 
of the channels . 

The other construction of this embodiment is identical 
5 to those explained in connection with the fifth and sixth 
embodiment. Thus its explanation is omitted here. 

When this seventh embodiment is employed, one can obtain 
advantages in that it is possible to reduce the amount of the 
calculations for the spectrum correction gain, the spectrum 

10 smoothing coefficient and smoothing of the spectrum as well as 
to reduce the memory space for storing the spectrum correction 
gain and the spectrum smoothing coefficient, adding to the 
advantages of the third embodiment of the present invention. 

As explained above, in the noise suppression apparatus 

15 according to one aspect of the present invention, following 
procedures is carried out . That is , corresponding to the noise 
likeness of the input signal frame, the noise amplitude spectrum 
is calculated using the input amplitude spectrum of the frame, 
then the noise amplitude spectrum correction gain and the noise 

20 removal spectrum correction gain are calculated on the basis 
of the noise amplitude spectrum, an input amplitude spectrum 
and respective coefficients; the first noise removal spectrum 
is calculated by deducting the product of the noise amplitude 
spectrum and the noise amplitude spectrum correction gain from 

25 the input amplitude spectrum; the second noise removal spectrum 
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is calculated by multiplying the first noise removal spectrum 
by the noise removal spectrum correction gain, which is sent 
from the correction gain calculation unit; and the second noise 
removal spectrum is transformed into a time domain signal. 
5 Because a suitable spectrum reduction and spectrum amplitude 
suppression corresponding not only to the noise signal level 
but also to the input signal level are carried out, even at a 
section where the input sound signal suddenly changes, for 
example, at the head portion of words in speech. The impression 

10 of extinguishment or hiding of the head portion of the words 
in speech, due to an excessive spectrum reduction or suppression 
can be avoided. It is possible to enhance the noise suppression 
in sound sections, avoiding an excessive spectrum suppression 
in sound sections. Thus, a suitable noise suppression can be 

15 attained. 

Further, because the noise removal spectrum correction 
gain is multiplied by the first noise removal spectrum, so- 
called residual noises, which may be caused by the residual 
noise, which is the residual portion of the spectrum after the 

20 spectrum reduction and so-called musical noises, which may be 
caused by the spectrum reduction, can be suppressed. 

Further, a spectrum smoothing coefficient control 
corresponding to the noise likeness is attained, by carrying 
out the following procedures . That is , smoothing of the input 

25 amplitude spectrum and the noise amplitude spectrum in the time 



base and the frequency base, on the basis of the input amplitude 
spectrum and the noise amplitude spectrum, corresponding to the 
state of the input signal; the calculation of the smoothed input 
amplitude spectrum and the smoothed noise amplitude spectrum; 
and the calculation of the noise amplitude spectrum correction 
gain and the noise removal spectrum correction gain, on the 
basis of the smoothed input amplitude spectrum and the smoothed 
noise amplitude spectrum. The spectrum smoothing coefficient 
is controlled, corresponding to the level of the noise likeness . 
As a result, it is possible to weaken the smoothness at sections 
where the noise likeness is small, i.e., at a sound section, 
and on the contrary, to enhance the smoothness at sections where 
the noise likeness is large. Thus a further suitable control 
of the spectrum correction gain, which allows further suitable 
noise suppression . 

The noise suppression apparatus further comprises a 
spectrum band dividing unit for dividing the input amplitude 
spectrum into a plurality of the frequency bands to output an 
average spectrum for each of the frequency bands, and for 
dividing the noise amplitude spectrum into a plurality of the 
frequency bands to output an average spectrum for each of the 
frequency bands, the average spectra are used in calculations 
of the smoothing coefficients and the smoothed spectrums . As 
a result, the impression of extinguishment or hiding of the head 
portion of the words in speech, due to an excessive spectrum 



reduction or suppression can be avoided. It is possible to 
enhance the noise suppression in sound sections , simultaneously 
avoiding an excessive spectrum suppression in sound sections. 
Thus, a suitable noise suppression can be attained. The 
5 spectrum smoothing coefficient is controlled, corresponding to 
the level of the noise likeness. As a result, it is possible 
to weaken the smoothness at sections where the noise likeness 
is small, i.e., at a sound section, and on the contrary, to 
enhance the smoothness at sections where the noise likeness is 
10 large. Thus a further suitable control of the spectrum 
correction gain, which allows further suitable noise 
suppression . 

Further, the input amplitude spectrum and the noise 
amplitude spectrum are smoothed, on the basis of the spectrum 

15 smoothing coefficients corresponding to the state of the input 
signal, and the noise suppression processing is carried out, 
on the basis of the spectrum correction gain, which is 
calculated from the smoothed input amplitude spectrum and the 
noise amplitude spectrum. Thus, the variation of the spectrum 

20 correction gain can be controlled, corresponding to the state 
of the input signal. For example, even when the SNR is low, 
i.e., in noise sections, etc, the impression of the 
discontinuity in the noise removal spectrum in the time base 
and the frequency base can be reduced, and the generation of 

25 strange sound in such sections can be avoided, namely a stable 



noise suppression can be attained. 

Further, the following procedure is carried out. That 
is, smoothing of the input amplitude spectrum and the noise 
amplitude spectrum, on the basis of the smoothing coefficients 
of the input amplitude spectrum and the noise amplitude spectrum, 
corresponding to the state of the input signal; calculations 
of the smoothed input amplitude spectrum and the smoothed noise 
amplitude spectrum; and calculations of the noise amplitude 
spectrum correction gain and the noise removal spectrum 
correction gain, on the basis of the smoothed input amplitude 
spectrum, smoothed noise amplitude spectrum and the spectrum 
correction gain limiting value. As a result, adding the 
advantages that the impression of extinguishment or hiding of 
the head portion of the words in speech, due to an excessive 
spectrum reduction or suppression, can be avoided, and that it 
is possible to enhance the noise suppression in noise sections, 
simultaneously avoiding an excessive spectrum suppression in 
sound sections so that a suitable noise suppression can be 
attained, another advantages are obtained in that it is possible 
to reduce the amount of the calculations for the spectrum 
correction gain and to reduce the memory space for storing the 
spectrum correction gain. 

Further, the following procedure is carried out. That 
is, the input amplitude spectrum is divided into a plurality 
of frequency bands and the average spectrum is calculated; the 



noise amplitude spectrum is divided, into a plurality of 
frequency bands and the average spectrum is calculated; the 
smoothing coefficients of the input amplitude spectrum and the 
noise amplitude spectrum are calculated for each frequency 
band; and the smoothed input amplitude spectrum and the smoothed 
noise amplitude spectrum are calculated, on the basis of the 
input amplitude average spectrum of each frequency band and the 
noise amplitude average spectrum of each frequency band. Thus, 
the spectrum smoothing coefficient is controlled, 
corresponding to the level of the noise likeness. As a result, 
it is possible to weaken the smoothness at sections where the 
noise likeness is small, i.e., at sound sections, and on the 
contrary, to enhance the smoothness at sections where the noise 
likeness is large, i.e., in noise sections. Thus a further 
suitable control of the spectrum correction gain, which allows 
further suitable noise suppression. Further, another 
advantages are obtained in that it is possible to reduce the 
amount of the calculations for the spectrum correction gain and 
for smoothing the spectrum, and to reduce the memory space for 
storing the spectrum correction gain. 

Further, the spectrum smoothing coefficient calculation 
unit, the spectrum smoothing unit, the spectrum correction gain 
limiting value calculation unit and the correction gain 
calculation unit do not use the input amplitude spectrum nor 
the noise amplitude spectrum, but use average spectra which are 
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obtained, respectively, by dividing the input amplitude 
spectrum and the noise amplitude spectrum into a plurality of 
frequency bands and by calculating their average spectra. As 
a result, the impression of extinguishment or hiding of the head 
portion of the words in speech, due to an excessive spectrum 
reduction or suppression, can be avoided, and it is possible 
to enhance the noise suppression in noise sections, and avoiding 
an excessive spectrum suppression in sound sections so that a 
suitable noise suppression can be attained. The spectrum 
smoothing coefficient is controlled, corresponding to the level 
of the noise likeness. As a result, it is possible to weaken 
the smoothness at sections where the noise likeness is small, 
i.e., at sound sections, and on the contrary, to enhance the 
smoothness at sections where the noise likeness is large, i.e. , 
in noise sections. Thus a further suitable control of the 
spectrum correction gain, which aliows further suitable noise 
suppression, can be attained. Further, another advantages are 
obtained in that it is possible to reduce the amount of the 
calculations for calculating the spectrum correction gain, for 
calculating the spectrum smoothing coefficients and for 
smoothing the spectrum, as well as to reduce the memory space 
for storing the spectrum correction gain and the spectrum 
smoothing coefficients. 

Although the invention has been described with respect 
to a specific embodiment for a complete and clear disclosure, 



the appended claims are not to be thus limited but are to be 
construed as embodying all modifications and alternative 
constructions that may occur to one skilled in the art which 
fairly fall within the basic teaching herein set forth. 
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WHAT IS CLAIMED IS : 

1. A noise suppression apparatus, which can remove an 
inutile noise from an input signal comprising an object signal 
and the inutile noise mixed therein to output the object signal, 
said apparatus comprising: 

a time/frequency conversion unit which converts the input 
signal into an amplitude spectrum and a phase spectrum by 
frequency- analyzing the input signal in each frame; 

a noise- likeness analyzing unit which determines the 
noise-likeness of the input signal frame; 

a noise amplitude spectrum calculation unit which 
calculates the noise amplitude spectrum from the input 
amplitude spectrum of the frame on the basis of the result of 
said noise-likeness analyzing unit; 

a spectrum correction gain calculation unit which 
calculates a noise amplitude spectrum correction gain, on the 
basis of the input amplitude spectrum, the noise amplitude 
spectrum and a first predetermined coefficient, and which 
calculates a noise removal spectrum correction gain, on the 
basis of the input amplitude spectrum, the noise amplitude 
spectrum and a second predetermined coefficient; 

a spectrum deduction unit which calculates a product of 
the noise amplitude spectrum and the noise amplitude spectrum 
correction gain, which is sent from said spectrum correction 
gain calculation unit, then deducts the product from the input 



amplitude spectrum so as to output a first noise removal 
spectrum; 

a spectrum suppression unit which calculates a product 
of the first noise removal spectrum and the noise removal 
spectrum correction gain so as to output a second noise removal 
spectrum ; and 

a frequency/ time conversion unit which converting the 
second noise removal spectrum to a time domain signal. 

2 . The noise suppression apparatus according to claim 1 
wherein said spectrum correction gain calculation unit 
comprises , 

a spectrum correction gain limiting value calculation 
unit which calculates spectrum correction gain limiting values , 
on the basis of the input amplitude spectrum and the noise 
amplitude spectrum, which spectrum correction gain limiting 
values limit the correction gains of the noise amplitude 
spectrum and the noise removal spectrum; and 

a correction gain calculation unit which calculates a 
noise amplitude spectrum correction gain and a noise removal 
spectrum correction gain, on the basis of the input amplitude 
spectrum, the noise amplitude spectrum and the spectrum 
correction gain limiting value, which noise amplitude spectrum 
correction gain corrects the value of the amplitude of the noise 
amplitude spectrum in each frequency component , and which noise 



removal spectrum correction gain corrects the value of the 
amplitude of the noise removal spectrum for each frequency 
component . 

3. The noise suppression apparatus according to claim 2 
further comprising a spectrum band dividing unit which divides 
the input amplitude spectrum sent from said time /frequency 
conversion unit into a plurality of frequency bands and 
calculates the average spectrum of each frequency band, and 
divides the noise amplitude spectrum from said noise amplitude 
spectrum calculation unit into a plurality of frequency bands 
and calculates the average spectrum of each frequency band, 
wherein said spectrum correction gain limiting value 
calculation unit and said correction gain calculation unit, 
that form said spectrum correction gain calculation unit, 
calculate the spectrum amplitude limiting value, noise 
amplitude spectrum correction gain and the noise removal 
spectrum correction gain, on the basis of average spectrum of 
each frequency band of the input amplitude spectrum and the 
noise amplitude spectrum, which are outputs of said spectrum 
band dividing unit, in place of the input amplitude spectrum 
and the noise amplitude spectrum. 
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4 . The noise suppression apparatus according to claim 1 
further comprising, 

a spectrum smoothing coefficient calculation unit which 
calculates smoothing coefficients of the input amplitude 
spectrum and the noise amplitude spectrum, according to the 
state of the input signal; and 

a spectrum smoothing unit which smoothes the input 
amplitude spectrum and the noise amplitude spectrum in the time 
base and in the frequency base, on the basis of the spectrum 
smoothing coefficients, and outputs a smoothed input amplitude 
spectrum and a smoothed noise amplitude spectrum, 

wherein said spectrum correction gain calculation unit 
comprises a correction gain calculation unit which calculates 
a noise amplitude spectrum correction gain and a noise removal 
spectrum correction gain, on the basis of the smoothed input 
amplitude spectrum and the smoothed noise amplitude spectrum, 
which noise amplitude spectrum correction gain is used for 
correcting the value of the amplitude for each frequency 
component of the noise amplitude spectrum, and which noise 
removal spectrum correction gain is used for correcting the 
value of the amplitude of the noise removal spectrum. 

5. The noise suppression apparatus according to claim 4 
further comprising a spectrum band dividing unit which divides 
the input amplitude spectrum sent from said time /frequency 



conversion unit into a plurality of frequency bands and 
calculates the average spectrum of each frequency band, and 
divides the noise amplitude spectrum sent from said noise 
amplitude spectrum calculation unit and calculates the average 
5 spectrum of each frequency band, 

wherein said spectrum smoothing coefficient calculation 
unit calculates smoothing coefficients for the input amplitude 
spectrum and the noise amplitude spectrum, on the basis of the 
input amplitude average spectrum of each frequency band and the 
10 noise amplitude average spectrum of each frequency band, which 
are sent from said spectrum band dividing unit, and 

wherein said spectrum smoothing unit calculates the 
smoothed input amplitude spectrum and the smoothed noise 
amplitude spectrum, on the basis of the input amplitude average 
15 spectrum of each frequency band and the noise amplitude average 
spectrum of each frequency band, which are sent from said 
spectrum band dividing unit. 



6. The noise suppression apparatus according to claim 2 
20 further comprising, 

a spectrum smoothing coefficient calculation unit which 
calculates the smoothing coefficients for the input amplitude 
spectrum and the noise amplitude spectrum, according to the 
state of the input signal; and 
25 a spectrum smoothing unit which smoothes the input 
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amplitude spectrum and the noise amplitude spectrum in the time 
base and in the frequency base, using the smoothing coefficients 
of the spectra, 

wherein said correction gain calculation unit calculates 
the noise amplitude spectrum correction gain and the noise 
removal spectrum correction gain, on the basis of the smoothed 
input amplitude spectrum, smoothed noise amplitude spectrum and 
the spectrum correction gain limiting value, in place of the 
input amplitude spectrum and the noise amplitude spectrum. 

7. The noise suppression apparatus according to claim 6 
further comprising a spectrum band dividing unit which divides 
the input amplitude spectrum sent from said time/ frequency 
conversion unit into a plurality of frequency bands and 
calculates the average spectrum of each frequency band, and 
divides the noise amplitude spectrum sent from said noise 
amplitude spectrum calculation unit into a plurality of 
frequency bands and calculates the average spectrum of each 

frequency band, 

wherein said spectrum smoothing coefficient calculation 
unit, said spectrum smoothing unit, said spectrum correction 
gain limiting value calculation unit and said correction gain 
calculation unit use the output from said spectrum band dividing 
unit in place of the input amplitude spectrum and the noise 
amplitude spectrum, for carrying out their function. 



8 . The noise suppression apparatus according to claim 4 
wherein said spectrum smoothing coefficient calculation unit 
calculates the smoothing coefficients for the input amplitude 
spectrum and the noise amplitude spectrum, according to the 

5 result of the noise likeness analyzing unit. 

9. The noise suppression apparatus according to claim 6 
wherein said spectrum smoothing coefficient calculation unit 
calculates the smoothing coefficients for the input amplitude 

10 spectrum and the noise amplitude spectrum, according to the 
result of the noise likeness analyzing unit. 
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ABSTRACT OF THE D ISCLOSURE 

In the noise suppression apparatus , a spectrum correction 
gain calculation unit calculates the noise amplitude spectrum 
correction gain and the noise removal spectrum correction gain 
5 using the input amplitude spectrum, noise amplitude spectrum 
and respective coefficients; a spectrum deduction unit deducts 
the product of the noise amplitude spectrum and the noise 
amplitude spectrum correction gain from the input amplitude 
spectrum and outputs the result as a first noise removal 
10 spectrum; a spectrum suppression unit multiplies the first 
noise removal spectrum by the noise removal spectrum correction 
gain and outputs the result as a second noise removal spectrum; 
finally a frequency/time conversion unit converts the second 
noise removal spectrum into a time domain signal. 
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Japanese Patent Application No. HE I 11-162240 (Not yet Laid- 
open) 

Application date : June 9, 1999 
Applicant : Mitsubishi Denki K. K. 
5 Title : NOISE SUPPRESSOR 

[Type of Document] ABSTRACT 
[Abstract] 

PROBLEM TO BE SOLVED: To provide a noise suppressor, in a speech 
10 communication system and a speech recognition system used in 
various noise environments, which can suppress a noise to such 
a low level that is aurally desirable and whose quality is not 
much degraded even under high noise levels . 

SOLUTION: The noise suppressor comprises a time /frequency 
15 transforming means 2 which subjects an input signal to frequency 
analysis for each frame and transforms the signal to an amplitude 
spectrum and a phase spectrum, a noise-level analyzing means 3 
which determines which level of a noise the input signal frame 
includes, an average noise spectrum updating and holding means 
20 4 which updates and holds an average noise spectrum using the 
amplitude spectrum of the frame based on the result of 
determination output from the noise-level analyzing unit 3, an 
aural weight computing means 6 which computes a plurality of aural 
weights to aurally weight the spectrums , an SN ratio calculating 
25 means 5 which calculates an SN ratio from the amplitude spectrum 



and the average noise spectrum, an aural weight control means 
7 which controls the plurality of aural weights with the SN ratio, 
a spectrum subtracting means 8 which multiplies the average noise 
spectrum by the aural weight that is output from the aural weight 
5 control means and subtracts the multiplied weight from the 
amplitude spectrum, a spectrum suppressing means 9 which 
multiplies the spectrum without noise that is obtained through 
the spectrum subtracting means by another, aural weight that is 
output from the aural weight control means, and a frequency/ time 
10 transforming means 10 which transforms the result of output of 
the spectrum suppressing means to a time-axis signal. 
SELECTED FIGURE: FIGURE 1 
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Declaration and Power of Attorney For Patent Application 
Japanese Language Declaration 



As a below named inventor, I hereby declare that: 



My residence, post office address and citizenship are as stated 
next to my name. 



3 (RMSI"**^) 



I believe I am the original, first and sole inventor (if only one 
name is listed below) or an original, first and joint inventor (if 
plural names are listed below) of the subject matter which is 
claimed and for which a patent is sought on the invention 
entitled. 

NOISE SUPPRESSION APPARATUS 



the specification of which 
S3 is attached hereto. 
□ was filed on 



as United States Application Number or 
PCT International Application Number 

and was amended on 

(if applicable). 



F%J&!hf WilF I hereby state that I have reviewed and understand the 
contents of the above identified specification, including the 
claims, as amended by any amendment referred to above. 



I acknowledge the duty to disclose information which is material 
to patentability as defined in Title 37, Code of Federal 
Regulations, Section 1 .56. 
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Ittt, *Bffi**35»119* (a) - (d) «Xtt365ft (b) 
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Prior Foreign Application^) 

11-319126 
(Number) 
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(Number) 



Japan 



(Country) 
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(Country) 
OS) 
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- (Application No.) (Filing Date) 

J (UJB**) (fcBJBB) 

'; TEO*fflffi*»35ill20*<cSr?^-CTE©*H#i ! f : 
365* (c) ca^<*«*CCC3EaL*fo a*. 

it^fSBS^i^^®^^ 
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(Application No.) 

(ajj«s#) 



(Filing Date) 
MS) 



(Application No.) 



(Ring Date) 
(ffiJUB) 



Page 



i hereby claim foreign priority under Title 35, United States Code, 
Section 119 (a)-(d) or 365(b) of any foreign appiication(s) for patent 
or inventor's certificate, or Section 365(a) of any PCT International 
application which designated at least one country other than the 
United States, listed below and have also identified below, by 
checking the box, any foreign application for patent or inventor's 
certificate, or PCT International application having a filing date 
before that of the application on which priority is claimed. 

Priority Claimed 

1 0 /November /1 99 9 E □ 

(Day/Month/Year Filed) 



(Day/Month/Year Filed) 
<tBJR*MH> 



Yes 

□ 

Yes 



No 

□ 
No 



I hereby claim the benefit under Title 35, United States Code, 
Section 1 1 9(e) of any United States provisional application(s) listed 
below. 



(Application No.) 
(tBJHS#) 



(Filing Date) 
(ttSJHB) 



I hereby claim the benefit under Title 35, United States Code, Section 
120 of any United States application^), or Section 365(c) of any PCT 
International application designating the United States, listed below 
and, insofar as the subject matter of each of the claims of this 
application is not disclosed in the prior United States or PCT 
International application in the manner provided by the first paragraph 
of Title 35, United States Code Section 112, 1 acknowledge the duty 
to disclose information which is material to patentability as defined in 
Title 37, Code of Federal Regulations, Section 1 .56 which became 
available between the filing date of the prior application and the 
national or PCT International filing date of application. 

(Status: Patented, Pending, Abandoned) 

mu : wfffff bts, mm*. 

(Status: Patented, Pending, Abandoned) 

i hereby declare that all statements made herein of my own 
knowledge are true and that all statements made on information 
and belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the 
like so made are punishable by fine or imprisonment, or both, under 
Section 1001 of Title 18 of the United States Code and that such 
willful false statements may jeopardize the validity of the application 
or any patent issued thereon. 
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Norman F. Obion, Registration Number 24,618; Marvin J. Spivak, Registration Number 24,913; C. trvin McClelland, Registration Number 21,124; Gregory J. 
Maier, Registration Number 25,599; Arthur I. Neustadt, Registration Number 24,854; Richard D. Kelly, Registration Number 27,757; James D. Hamilton, 
Registration Number 28,421 ; Eckha/d H. Kuesters, Registration Number 28,870; Robert T. Pous, Registration Number 29,099; Charles L Gholz t Registration 
Number 26,395; Vincent J. Sunderdick, Registration Number 29,004; William E. Beaumont, Registration Number 30,996; Steven B. Keiber, Registration 
Number 30,073; Robert F. Gnuse, Registration Number 27,295; Jean-Paul Lavaileye, Registration Number 31 ,45 1 ; Stephen G. Baxter, Registration Number 
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